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IN THE CLAIMS: 

The text of all pending claims (including withdrawn claims) is set forth below. Cancelled 
and not entered claims are indicated with claim number and status only. The claims as listed 
below show added text with underlining and deleted text with strik e through . The status of each 
claim is indicated with one of (original), (currently amended), (cancelled), (withdrawn), (new), 
(previously presented), or (not entered). 

Please ADD new claim 136 in accordance with the following: 

1-18. (CANCELLED) 

19. (WITHDRAWN) A control system for controlling a display device including a 
display unit displaying a motion picture, and a pointing unit pointing a position on the motion 
picture, said control system comprising: 

a recognizing unit recognizing an object in the motion picture on which a pointing 
manipulation is effected; and 

a processing unit executing a predetermined process related to the object recognized, 

and 

wherein said processing unit, when the object is recognized from the pointing 
manipulation during the displaying of the motion picture contained in a first data, commands said 
display device to effect a first changeover to an output of a second data related to the object, 
and said processing unit commands said display device to execute a second changeover to 
display the motion picture after outputting the second data, and 

said display device includes a recording unit recording data related to the motion picture 
contained in the first data and said output of the second data, and said processing unit, after 
outputting the second data, issues a command of displaying the motion picture from a point of 
the first changeover recorded on said recording unit. 

20. (CANCELLED) 

21 . (WITHDRAWN) A control system for controlling a display device including a 
display unit displaying a motion picture, and a pointing unit pointing a position on the motion 
picture, said control system comprising: 
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a communication unit transmitting the position on the motion picture receiving a pointing 
manipulation to a server including a unit recognizing an object in the motion picture receiving the 
pointing manipulation, and receiving, from said server, information on the object in the motion 
picture recognized by said server; and 

a processing unit executing a predetermined process related to the object recognized. 

22. (WITHDRAWN) The control system according to claim 21 , wherein said display 
device further includes a receiving unit receiving data, 

wherein said receiving unit receives first data containing the motion picture, and second 
data related to the object in the motion picture contained in the first data, and 

said processing unit makes said display device output the second data related to the 
object recognized. 

23. (WITHDRAWN) The control system according to claim 22, wherein the second 
data contains an image related to the motion picture of the first data. 

24. (WITHDRAWN) The control system according to claim 22, wherein the second 
data is multiplexed with the first data and thus distributed. 

25. (WITHDRAWN) The control system according to claim 24, wherein the first data 
is constructed with a predetermined data structure and the second data is embedded in a 
margin formed in the data structure. 

26-28. (CANCELLED) 

29. (PREVIOUSLY PRESENTED) A control system for controlling a display device 
including a reproducing unit reproducing a motion picture recorded on a recording medium 
wherein said recording medium is recorded with an image related to an object together with the 
motion picture, a display unit displaying the motion picture reproduced by the reproducing unit, 
and a pointing unit pointing a position on the motion picture, said control system comprising: 

a communication unit transmitting the position on the motion picture receiving a pointing 
manipulation to a server including a unit recognizing an object in the motion picture based on the 
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position on the motion picture, and receiving, from said server, information on the object in the 
motion picture recognized by said server; and 

a processing unit executing a predetermined process related to the object recognized, 

and 

wherein said processing unit makes said reproducing unit reproduce from said recording 
medium the image related to the object and makes said display device display the reproduced 
image. 

30. (CANCELLED) 

31 . (WITHDRAWN) The control system according to claim 21 , wherein said display 
device further includes a reproducing unit reproducing the motion picture recorded on recording 
medium, and 

said communication unit , when the motion picture to be reproduced receives the 
pointing manipulation, transmits, to said server, information for specifying the motion picture to 
be reproduced and information for specifying a position where the pointing manipulation is 
effected on the motion picture. 

32. (WITHDRAWN) A server in linkage with a display device including a receiving 
unit receiving data containing a motion picture, a display unit displaying the motion picture, and a 
pointing unit pointing a position on the motion picture, said server comprising: 

a communication unit receiving information on the position where a pointing manipulation 
is effected from said display device; 

a recognizing unit recognizing an object in the motion picture receiving the pointing 
manipulation based on the information received from said display device; and 

a processing unit executing a predetermined process related to the object recognized. 

33. (WITHDRAWN) The server according to claim 32, wherein said processing unit 
transmits the information on the object recognized to said display device via said communication 
unit. 

34-37. (CANCELLED) 
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38 (WITHDRAWN) A server issuing a command to a data distribution system in 
linkage with a display device including a receiving unit receiving data containing a motion picture 
from the data distribution system, a display unit displaying the motion picture, and a pointing unit 
pointing a position on the motion picture, said server comprising: 

a communication unit receiving information on the position where a pointing manipulation 
is effected on the motion picture from said display device; 

a recognizing unit recognizing an object in the motion picture receiving the pointing 
manipulation based on the information received from said display device; 

a referring unit referring to an instruction related to the object; and 

a commanding unit commanding said data distribution system to change over the data 
containing the motion picture to be distributed in accordance with the instruction. 

39-60. (CANCELLED) 

61 . (WITHDRAWN) A computer readable storage medium embodying a program of 
instructions executable by a machine to control a display device including a display unit 
displaying a motion picture and a pointing unit pointing a position on the motion picture, 
comprising: 

recognizing an object in the motion picture on which a pointing manipulation is effected; 

and 

executing a predetermined process related to the object recognized, 

wherein said predetermined process involves, when the pointing manipulation occurs 
during the displaying of the motion picture contained in a first data, commanding said display 
device to output, after an end of displaying the motion picture, a second data related to the 
object recognized by the pointing manipulation, 

said display device includes a recording unit recording data related to the motion picture 
contained in the first data and said the second data to be output, and 

said predetermined process involves, when the object is recognized from the pointing 
manipulation during the displaying of the motion picture, commanding said recording unit to 
record the second data related to the object, and commanding said display device to output, 
after the end of displaying the motion picture, the second data recorded. 

62. (CANCELLED) 
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63. (CANCELLED) 

64. (WITHDRAWN) A computer readable storage medium embodying a program of 
instructions executable by a machine to control a display device including a display unit 
displaying a motion picture and a pointing unit pointing a position on the motion picture, 
comprising: 

recognizing an object in the motion picture on which a pointing manipulation is effected; 

and 

executing a predetermined process related to the object recognized, and 
wherein said predetermined process involves, when the object is recognized from the 
pointing manipulation during the displaying of the motion picture contained in a first data, 
commanding said display device to effect a first changeover to an output of a second data 
related to the object, and said predetermined process involves commanding said display device 
to execute a second changeover to displaying the motion picture after outputting the second 
data, and 

said display device further includes a recording unit recording data related to the motion 
picture contained in the first data and said output of the second data, and 
said predetermined process involves issuing a command of displaying, after outputting the 
second data, the motion picture from a point of the first changeover recorded on said recording 
unit. 

65. (CANCELLED) 

66. (PREVIOUSLY PRESENTED) A computer readable storage medium embodying 
a program of instructions executable by a machine including a communication unit to control a 
display device including a display unit displaying a motion picture and a pointing unit pointing a 
position on the motion picture, to perform operations comprising: 

transmitting the position on the motion picture receiving a pointing manipulation to a 
server including a recognizing unit recognizing an object in the motion picture receiving the 
pointing manipulation; 

receiving, from said server, information on the object in the motion picture recognized by 
said server; and 

executing a predetermined process related to the object recognized. 


6 


Serial No. 09/955,059 

67. (PREVIOUSLY PRESENTED) The storage medium readable by a machine 
tangible embodying a program according to claim 66, wherein said display device further 
includes a receiving unit receiving data, 

said receiving unit receives first data containing the motion picture, and second data 
related to the object in the motion picture contained in the first data, and 

said predetermined process involves making said display device output the second data 
related to the object recognized. 

68. (PREVIOUSLY PRESENTED) The storage medium readable by a machine 
tangible embodying a program according to claim 67, wherein the second data contains an 
image related to the motion picture of the first data. 

69. (PREVIOUSLY PRESENTED) The storage medium readable by a machine 
tangible embodying a program according to claim 67, wherein the second data is multiplexed 
with the first data and thus distributed. 

70. (PREVIOUSLY PRESENTED) The storage medium readable by a machine 
tangible embodying a program according to claim 69, wherein the first data is constructed with a 
predetermined data structure and the second data is embedded in a margin formed in the data 
structure. 

71-73. (CANCELLED) 

74. (PREVIOUSLY PRESENTED) The storage medium readable by a machine 
tangible embodying a program according to claim 66, wherein said display device includes a 
reproducing unit reproducing the motion picture recorded on a recording medium, 

said recording medium is recorded with an image related to an object of a corresponding 
motion picture, and 

said predetermined process involves reproducing from said recording medium the image 
related to the object and making said display device display the reproduced image. 

75. (CANCELLED) 
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76. (PREVIOUSLY PRESENTED) The storage medium readable by a machine 
tangible embodying a program according to claim 66, further comprising reproducing the motion 
picture recorded on a recording medium, 

wherein said transmitting involves, when the motion picture to be reproduced receives 
the pointing manipulation, transmitting, to said server, information for specifying the motion 
picture to be reproduced and information for specifying a position where the pointing 
manipulation is effected on the motion picture. 

77. (WITHDRAWN) A storage medium readable by a machine embodying a 
program of instructions executable by the machine including a communication unit to operate in 
linkage with a display device including a receiving unit receiving data containing a motion 
picture, a display unit displaying the motion picture, and a pointing unit pointing a position on the 
motion picture, to perform operations comprising: 

receiving information on the position where a pointing manipulation is effected from said 
display device; 

recognizing an object in the motion picture receiving the pointing manipulation based on 
the information received from said display device; and 

executing a predetermined process related to the object recognized. 

78. (WITHDRAWN) The storage medium readable by a machine tangible embodying 
a program according to claim 77, wherein said predetermined process further includes 
transmitting an information on the object recognized to said display device. 

79-82. (CANCELLED) 

83. (WITHDRAWN) A computer readable storage medium embodying a program of 
instructions executable by a machine including a communication unit issuing a command to a 
data distribution system in linkage with a display device including a receiving unit receiving data 
containing a motion picture from said data distribution system, a display unit displaying the 
motion picture and a pointing unit pointing a position on the motion picture, to perform operations 
comprising: 

receiving information on the position where a pointing manipulation is effected on the 
motion picture from said display device; 
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recognizing an object in the motion picture receiving the pointing manipulation based on 
the information received from said display device; 

referring to an instruction related to the object; and 

commanding said data distribution system to change over data to be distributed in 
accordance with the instruction. 

84-108. (CANCELLED) 

1 09. (WITHDRAWN) A control method of controlling a display device including a 
display unit displaying a motion picture and a pointing unit pointing a position on the motion 
picture, said method comprising: 

recognizing an object in the motion picture on which a pointing manipulation is effected; 

and 

executing a predetermined process related to the object recognized, and 
wherein said predetermined process involves, when the object is recognized from the 
pointing manipulation during the displaying of the motion picture contained in a first data, 
commanding said display device to effect a first changeover to an output of a second data 
related to the object, 

said predetermined process involves commanding said display device to execute a 
second changeover to displaying the motion picture after outputting the second data, and 

said display device further includes a recording unit recording data related to the motion 
picture contained in the first data and said output of the second data, and said predetermined 
process involves issuing a command of displaying the motion picture from a point of the first 
change over recorded on said recording unit after outputting the second data. 

110. (CANCELLED) 

111 . (WITHDRAWN) A control method of controlling a display device including a 
display unit displaying a motion picture and a pointing unit pointing a position on the motion 
picture, said method comprising: 

transmitting the position on the motion picture receiving a pointing manipulation to a 
server including a recognizing unit recognizing an object in the motion picture receiving the 
pointing manipulation; 
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receiving, from said server, information on the object in the motion picture recognized by 
said server; and 

executing a predetermined process related to the object recognized. 

112. (WITHDRAWN) The control method according to claim 111 , wherein said display 
device further includes a receiving unit receiving data, 

said receiving unit receives first data containing the motion picture, and second data 
related to the object in the motion picture contained in the first data, and 

said predetermined process involves making said display device output the second data 
related to the object recognized. 

113. (WITHDRAWN) The control method according to claim 112, wherein the second 
data contains an image related to the motion picture of the first data. 

114. (WITHDRAWN) The control method according to claim 112, wherein the second 
data is multiplexed with the first data and thus distributed. 

115. (WITHDRAWN) The control method according to claim 114, wherein the first 
data is constructed with a predetermined data structure and the second data is embedded in a 
margin formed in the data structure. 

116-120. (CANCELLED) 

121. (WITHDRAWN) The control method according to claim 111, further comprising 
reproducing the motion picture recorded on recording medium, 

wherein said transmitting involves, when the motion picture to be reproduced receives 
the pointing manipulation, transmitting, to said server, information for specifying this motion 
picture and information for specifying a position where the pointing manipulation is effected on 
the motion picture. 

122. (WITHDRAWN) An information processing method for a computer including a 
communication unit to operate in linkage with a display device including a receiving unit 
receiving data containing a motion picture, a display unit displaying the motion picture, and a 
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pointing unit pointing a position on the motion picture, said method comprising: 

receiving information on the position where a pointing manipulation is effected from said 
display device; 

recognizing an object in the motion picture receiving the pointing manipulation based on 
the information received from said display device; and 

executing a predetermined process related to the object recognized. 

123. (WITHDRAWN) The information processing method according to claim 122, 
wherein said predetermined process further includes transmitting an information on the object 
recognized to said display device. 

124-127. (CANCELLED) 

128. (WITHDRAWN) An information processing method for a computer including a 
communication unit to issue a command to a data distribution system in linkage with a display 
device including a receiving unit receiving data containing a motion picture from said data 
distribution system, a display unit displaying the motion picture and a pointing unit pointing a 
position on the motion picture, said method comprising: 

receiving information on the position where a pointing manipulation is effected on the 
motion picture; 

recognizing an object in the motion picture receiving the pointing manipulation based on 
the information received from said display device; 

referring to an instruction related to the object; and 

commanding said data distribution system to change over the data containing the motion 
picture to be distributed in accordance with the instruction. 

129-135. (CANCELLED) 

1 36. (NEW) A control method of controlling a display device including a display unit 
displaying a motion picture and a pointing unit pointing a position on the motion picture, said 
method comprising: 

recognizing an object in the motion picture on which the pointing manipulation is effected; 
and executing a predetermined process related to the object recognized, and 
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wherein said display device includes a reproducing unit reproducing the motion picture 
recorded on a recording medium, 

said recording medium is recorded with a first motion picture and a second image related 
to an object corresponding to the first motion picture, and 

said predetermined process involves reproducing from said recording medium the 
second image related to the object recognized and making said display device display the 
reproduced second image. 
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